Astro-WISE processing of wide-field images and other data

نویسندگان

  • Hugo Buddelmeijer
  • O. Rees Williams
  • John McFarland
  • Andrey N. Belikov
چکیده

Astro-WISE1 (Vriend et al. 2012) is the Astronomical Wide-field Imaging System for Europe (Valentijn et al. 2007). It is a scientific information system which consists of hardware and software federated over about a dozen institutes throughout Europe. It has been developed to exploit the ever increasing avalanche of data produced by astronomical surveys and data intensive scientific experiments in general. The demo explains the architecture of the Astro-WISE information system and shows the use of Astro-WISE interfaces. Wide-field astronomical images are derived from the raw image to the final catalog according to the user’s request. The demo is based on the standard Astro-WISE guided tour, which can be accessed from the AstroWISE website. The typical Astro-WISE data processing chain is shown, which can be used for data handling for a variety of different instruments, currently 14, including OmegaCAM, MegaCam, WFI, WFC, ACS/HST, etc2. 1. Typical Data Processing Chain Astro-WISE was originally designed to handle the large datasets from the OmegaCAM instrument such as the KiDS survey (Verdoes Kleijn et al. 2012). The backbone of Astro-WISE is set by the way it captures all science products obtained in survey operations in an object-oriented data model. Figure 1 shows the main astronomical classes in the Astro-WISE environment, the basic elements of the data processing chain. Each block is a class and each instance of a class is called a Target. The class incorporates a method to derive the data of the Target from other objects, called its dependencies. The user has an ability to combine recipes in a pipeline to process the data by directly requesting the final required data product he or she is interested in. All processing parameters, along with the full data lineage, are saved in the metadata through the persistence of all objects. In the demo the user goes from a RawScienceFrame (raw frame observed by the VST and ingested in Astro-WISE) to a SourceList (the cata1http://www.astro-wise.org 2http://www.astro-wise.org/portal/instruments_index.shtml

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Astro-WISE Information System

Astro-WISE is a scientific information system for the data processing of optical images. In this paper we review main features of Astro-WISE and describe the current status of the system.

متن کامل

Astro-WISE and Grid

The paper reviews the Astro-WISE infrastructure and demonstrates that the Astro-WISE Information System provides a Grid itself. We describe the integration of Astro-WISE with an external Grid infrastructure (BiGGrid). The integration is performed on all infrastructural layers (data storage, metadata and processing layers) with Astro-WISE as a “master” infrastructure. We report the use of the in...

متن کامل

The Astro-WISE approach to quality control for astronomical data

We present a novel approach to quality control during the processing of astronomical data. Quality control in the Astro-WISE Information System is integral to all aspects of data handing and provides transparent access to quality estimators for all stages of data reduction from the raw image to the final catalog. The implementation of quality control mechanisms relies on the core features in th...

متن کامل

Tracing and using data lineage for pipeline processing in Astro-WISE

Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, ...

متن کامل

Lofar information system design

The Lofar Information System is a solution for Lofar Long Term Archive that is capable to store and handle PBs of raw and processed data. The newly created information system is based on Astro-WISE the information system for wide field astronomy. We review an adaptation of Astro-WISE for the new tasks and propose a generic solution for the publishing of the data from the Lofar Information Syste...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1111.6792  شماره 

صفحات  -

تاریخ انتشار 2011